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10 BACKGROUND OF THE INVENTION 



Field of the Invention 

15 The field of the invention is data processing, or, more specifically, methods, systems, 
and products for dynamically provisioning computer system resources. 

Description Of Related Art 

20 Existing data conmixinications environments have no way to dynamically provision 
computer resources to adapt to changes in current server load conditions. 
Connection-oriented data communications servers implement a listen or a connection 
backlog queue maximum size to administer data communications connections. The 
maximum size is usually a hard-coded limit. In AIX for example the maximum 

25 connection backlog queue size is 1024. Such maximum limits have no relationship 
to actual current server load. Connection-oriented ports may set a queue size at 
startup time smaller than such a system maximum, but the queue size cannot be 
changed without restarting the port. Once a queue subject to such a maximum is 
filled with connection requests, subsequent connection requests are dropped when 

30 they arrive, resulting in retransmissions from clients requesting connections. Most 
client systems will wait a period of time on the order of seconds before 
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retransmitting a connection request, causing delays perceptible to users. In addition, 
such retransmissions add to network congestion and contribute to server overloading. 

An altemative to limiting the maximum backlog queue size on a connection is to 
5 have a tunable maximum. A tunable maximum still suffers from disadvantages. A 
tunable maximum connection backlog queue size backlog is a system-wide limit 
enforced on all ports in a system. If such a parameter is set to a large value, system 
resources may be exhausted as the number of network services provided on the 
system grows. Although a port's initial backlog queue size can be initially set based 

10 on system resources, it cannot dynamically adapt to changing server load conditions. 
For example, in case the system is ligjitly loaded, and resources easily available, a 
specific port may not be able to handle incoming connections because the maximum 
backlog size limits the queue size. On the other hand, the system may be heavily 
loaded in which case a large constant backlog value may cause the system to exhaust 

15 its resources. 

SUMMARY OF THE INVENTION 

Methods, systems, and products are disclosed for dynamically provisioning server 
20 resources based on current data communications load conditions and other monitored 
connection performance parameters so that servers can dynamically change 
connection backlog queue size without interfering with port operations and without 
human intervention. More particularly, methods, systems, and products are disclosed 
for dynamically provisioning computer system resources that include monitoring a 
25 connection performance parameter of a data commimications port operating in a data 
communications protocol having a connection backlog queue having a connection 
backlog queue size; and changing the connection backlog queue size in dependence 
upon the monitored connection performance parameter without interrupting the 
operation of the data communications port and without user intervention. In typical 
30 embodiments of the present invention, monitoring a connection performance 
parameter includes receiving a connection request and determining that the 
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connection backlog queue is full, and changing the connection backlog queue size in 
dependence upon the monitored connection performance parameter includes 
increasing the connection backlog queue size. 

In typical embodiments of the present invention, monitoring a connection 
performance parameter includes monitoring a connection backlog queue load, and 
changing the connection backlog queue size includes changing the backlog queue size 
in dependence upon the connection backlog queue load, hi many embodiments, 
monitoring a connection performance parameter includes calculating an average 
round trip time for a portion of a connection handshake and calculating an average 
arrival interval between connection requests, and changing the connection backlog 
queue size includes increasing the connection backlog queue size if the average 
arrival interval is less than the average round trip time and decreasing the connection 
backlog queue size if the average arrival interval is greater than the average round trip 
time. 

In typical embodiments of the present invention, monitoring a connection 
performance parameter includes calculating a bandwidth delay product for a 
connection backlog queue and comparing the bandwidth delay product with the queue 
20 size; and changing the connection backlog queue size includes changing the backlog 
queue size to at least the bandwidth delay product if the connection backlog queue 
size is less than the bandwidth delay product. In many embodiments of the present 
invention, monitoring a connection performance parameter includes measuring accept 
processing time, and changing the connection backlog queue size includes changing 
25 the backlog queue size in dependence upon accept processing time. In some 

embodiments, monitoring a connection performance parameter includes calculating 
an average accept processing time and calculating an average connection request 
arrival interval for a connection backlog queue, and changing the connection backlog 
queue size includes increasing the connection backlog queue size if the accept 
30 processing time is greater than the connection request arrival interval. 
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The foregoing and other objects, features and advantages of the invention will be 
apparent from the following more particular descriptions of exemplary embodiments 
of the invention as illustrated in the accompanying drawings wherein like reference 
numbers generally represent like parts of exemplary embodiments of the invention. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 depicts an architecture for a data processing system in which various 
embodiments of the present invention may be implemented. 

10 

Figure 2 sets forth a block diagram of an exemplary protocol stack for data 
communications between two devices connected through a network. 

Figure 3 sets forth a block diagram of automated computing machinery in which 
15 computer system resources may be dynamically provisioned according to 
embodiments of the present invention. 

Figure 4 sets forth a flow chart illustrating an exemplary method for dynamically 
provisioning computer system resources. 

20 

Figure 5 sets forth a flow chart illustrating a further exemplary method for 
dynamically provisioning computer system resources. 

Figure 6 sets forth a flow chart illustrating a still ftirther exemplary method for 
25 dynamically provisioning computer system resources. 

Figure 7 sets forth a flow chart illustrating a still further exemplary method for 
dynamically provisioning computer system resources. 

30 Figure 8 sets forth a calling sequence diagram illustrating a TCP connection 
handshake to establish a connection between a client and a server. 
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Figure 9 sets forth a flow chart illustrating another exemplary method for dynamically 
provisioning computer system resources. 

5 Figure 10 sets forth a flow chart illustrating a still further exemplary method for 
dynamically provisioning computer system resources. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

10 Introduction 

The present invention is described to a large extent in this specification in terms of 
methods for dynamically provisioning computer system resources. Persons skilled in 
the art, however, will recognize that any computer system that includes suitable 

15 programming means for operating in accordance with the disclosed methods also falls 
well within the scope of the present invention. Suitable programming means include 
any means for directing a computer system to execute the steps of the method of the 
invention, including for example, systems comprised of processing units and 
arithmetic-logic circuits coupled to computer memory, which systems have the 

20 capability of storing in computer memory, which computer memory includes 

electronic circuits configured to store data and program instructions, programmed 
steps of the method of the invention for execution by a processing unit. 

The invention also may be embodied in a computer program product, such as a 
25 diskette or other recording medium, for use with any suitable data processing system. 
Embodiments of a computer program product may be implemented by use of any 
recording medium for machine-readable information, including magnetic media, 
optical media, or other suitable media. Persons skilled in the art will inmiediately 
recognize that any computer system having suitable programming means will be 
30 capable of executing the steps of the method of the invention as embodied in a 

program product. Persons skilled in the art will recognize immediately that, although 
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most of the exemplary embodiments described in this specification are oriented to 
software installed and executing on computer hardware, nevertheless, altemative 
embodiments implemented as firmware or as hardware are well within the scope of 
the present invention. 

5 

Dynamically Provisioning Computer System Resources 

Exemplary methods, systems, and products for dynamically provisioning computer 
system resources are now explained with reference to the accompanying drawings, 

10 beginning with Figure 1. Figure 1 depicts an architecture for a data processing 

system in which various embodiments of the present invention may be implemented. 
The data processing system of Figure 1 includes a number of computers connected 
for data communications through network (101). Network (101) may be any network 
for data communications, a local area network ("LAN"), a wide area network 

15 ("WAN"), an intranet, an internet, the Internet, a web, the World Wide Web itself, a 
Bluetooth microLAN, a wireless network, and so on, as will occur to those of skill in 
the art. Such networks are media that may be used to provide data commimications 
connections between various devices and computers connected together within an 
overall data processing system. 

20 

In the example of Figure 1, several exemplary devices including a PDA (1 12), a 
personal computer (104), a mobile phone (110), and a laptop computer (126) are 
connected to network (101). Network-enabled mobile phone (110) connects to 
network (101) through wireless link (116), and PDA (112) connects to network (101) 
25 through wireless link (114). In the example of Figure 1, personal computer (104) 
connects through wireline connection (122) to network (101), and laptop (126) 
connects through wireless link (1 1 8). Server (106) connects through wireline 
connection (123). 



30 The arrangement of servers and other devices making up the architecture illustrated in 
Figure 1 are for explanation, not for limitation. Data processing systems useful 
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according to various embodiments of the present invention may include additional 
servers, routers, other devices, and peer-to-peer architectures, not shown in Figure 1, 
as will occur to those of skill in the art. Networks in such data processing systems 
may support many data communications protocols, such as, for example, TCP/IP, 
5 HTTP, WAP, HDTP, and others as will occur to those of skill in the art. Various 
embodiments of the present invention may be implemented on a variety of hardware 
platforms in addition to those illustrated in Figure 1. 

Server (106) operates generally to dynamically provisioning computer system 
1 0 resources by monitoring a connection performance parameter of a data 

communications port operating in a data communications protocol having a 
connection backlog queue (124) having a connection backlog queue size. Server 
(106) receives connections requests from clients, and each connection request is 
acknowledged and then placed in a connection backlog queue until a connection is 
15 established between the server and the requesting client and accepted by an 

application on the server. In TCP, a connection request arrives in the form of a SYN 
message which is recorded as a socket in a SYN-RECD queue and moved to an 
'accept' queue when a corresponding ACK is receiving from the requesting host. In 
this specification, the SYN-RECD queue and the * accept' queue are referred to 
20 together as a connection backlog queue. 

The connection queue size is the maximum number of connection requests that can be 
stored in the connection backlog queue. The connection backlog queue also has a 
load characteristic. The connection backlog queue load is the number of connection 

25 requests presently awaiting processing in the queue. In the example of Figure 1, the 
connection backlog queue size is shown as 10 connection requests, and the 
connection backlog queue load is shown as three connection requests, leaving room 
for seven more requests in connection backlog queue (124). As described in more 
detail below, server (106) also operates to dynamically provisioning computer system 

30 resources by changing the connection backlog queue size in dependence upon a 

monitored connection performance parameter without interrupting the operation of 
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the data communications port and without user intervention. 

Data communications protocol operations are explained with reference to Figure 2. 
Figure 2 sets forth a block diagram of an exemplary protocol stack for data 
5 communications between two devices connected through a network. The exemplary 
protocol stack of Figure 2 is based on the standard Open Systems Interconnection 
("OSI") Reference Model. The exemplary protocol stack of Figure 2 includes several 
protocols stacked in layers. The exemplary protocol stack of Figure 2 begins at the 
bottom with a physical layer (208) that delivers unstructured streams of bits across 

10 links between devices. Physical layer connections may be implemented as wireline 
connections through modems or wireless connections through wireless 
communications adapters, for example. The exemplary stack of Figure 2 includes a 
link layer (206) that delivers a piece of information across a single link. The link 
layer organizes the physical layer's bits into packets and controls which device on a 

15 shared link gets each packet. The Ethernet protocol is an example of a link layer 
protocol. Ethemet addresses are 48 bit link layer addresses assigned uniquely to 
linked devices. A group of devices linked through a link layer protocol are often 
referred to as a LAN. 

20 The stack of Figure 2 includes a network layer (204) that computes paths across an . ■ 
interconnected mesh of links and packet switches and forwards packets over multiple 
links from source to destination. Packet switches operating in the network layer are 
typically referred to as "routers." The stack of Figure 2 includes a transport layer 
(203) that supports a reliable connection-oriented communication stream between a 

25 pair of devices across a network by putting sequence numbers in packets, holding 

packets at the destination until all arrive, and retransmitting lost packets. The stack of 
Figure 2 also includes an application layer (202) where application programs reside 
that use the network. Examples of such application programs include web browsers 
and email clients on the client side and web servers and email servers on the server 

30 side. 
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Data communications (212) in such a stack model is viewed as occurring layer by 
layer between devices, in this example, between a client (108), upon which is 
installed a data communications application such as a browser or an email client that 
requests a data conmiunications connection of server (106) in the transport layer. 
5 Data communication between the devices in the physical layer is viewed as occurring 
only in the physical layer, communication in the link layer is viewed as occurring 
horizontally between the devices only in the link layer, and so on. 

Vertical communication among the protocols in the stack is viewed as occurring 

1 0 through application progranMning interfaces ("APIs") (2 1 0) provided for that purpose. 
A browser, for example, operating as an application program in the application layer 
views its communications as coming and going directly to and from its coxmterpart 
web server on another device across the network. The browser effects its data 
communication by calls to a sockets API that in turn may operate a transmission 

15 control protocol ("TCP") client, for example, in the transport layer. The TCP client 
breaks a message into packets, gives each packet a transport layer header that 
includes a sequence number, and sends each packet to its counterpart on another 
device through an API call to the network layer. The network layer may implement, 
for example, the well known Internet Protocol ("IP") which give each packet an IP 

20 header and selects a conmiunication route through the network for each packet, and 
transmits each packet to its counterpart on another device by calling down through its 
link layer API, typically implemented as a driver API for a data communication card 
such as a network interface card or "NIC." When receiving data communication, the 
process is reversed. Each layer strips off its header and passes a received packet up 

25 through the protocol stack. Upward passes above the link layer typically require 
operating system context switches. 

Most connection-oriented data communications is effected in the transport layer, 
typically by use of the Transmission Control Protocol or "TCP." In addition, several 
30 examples in this specification are discussed in terms of TCP. It is useful to 

remember, however, that effecting data communications connections according to 
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embodiments of the present invention are not limited in any way to TCP. Other 
protocols may be used to effect connections in the transport layer, and connection- 
oriented data communications can be carried out according to embodiments of the 
present invention in any data communication layer and in any data communications 
5 protocol that support connection-oriented conrnixmications. 

In the example of Figure 2, a device that may request a connection is referred to as a 
* client' and the device that may accept the request for a connection is referred to as a 
'server.' ]n the example of Figure 1, server (106) is depicted as a server and the other 

10 devices, the laptop (126), the PDA (1 12), the personal computer (104), and the 

mobile phone (1 10) are clients. In the usual terminology of TCP, devices are referred 
to as *hosts,' clients are referred to as 'foreign hosts,' and servers are referred to as 
Mocal hosts.' All such devices, however, are computers, automated computing 
machinery of some kind. For further explanation, Figure 3 sets forth a block diagram 

15 of automated computing machinery comprising a computer (1 34) in which computer 
system resources may be dynamically provisioned according to embodiments of the 
present invention. The computer (134) of Figure 3 includes at least one computer 
processor (156) or 'CPU' as well as random access memory (168) (VRAM"). Stored 
in RAM (168) is an application program (152). Application programs include in 

20 particular application programs that may request or accept data communications 

connections, including browsers, email clients, web servers, and email servers. Also 
stored in RAM (168) is an operating system (154). Operating systems useful in 
computers according to embodiments of the present invention include Unix, Linux, 
Microsoft NTtmj and many others as will occur to those of skill in the art. TCP and 

25 other connection-oriented data communications clients and services are typically 
supported in an operating system. In particular, the functional steps of the present 
invention are typically carried out through computer program instructions 
implemented primarily within an operating system. 

30 The computer (1 34) of Figure 3 includes computer memory (1 66) coupled through a 
system bus (160) to processor (156) and to other components of the computer. 

10 
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Computer memory (166) may be implemented as a hard disk drive (170), optical disk 
drive (172), electrically erasable programmable read-only memory space (so-called 
'EEPROM' or 'Flash' memory) (174), RAM drives (not shown), or as any other kind 
of computer memory as will occur to those of skill in the art. 

5 

The example computer (134) of Figure 3 includes a communications adapter (167) for 
implementing connections for data communications (184), including connection 
through networks, to other computers (182), hosts, servers, and clients. 
Communications adapters implement the hardware level of connections for data 
1 0 communications through which local devices and remote devices or servers send data 
communications directly to one another and through networks. Examples of 
communications adapters include modems for wired dial-up connections, Ethemet 
(IEEE 802.3) adapters for wired LAN connections, and 802.1 lb adapters for wireless 
LAN connections. 

15 

The example computer of Figure 3 includes one or more input/output interface 
adapters (178). Input/output interface adapters in computers implement user-oriented 
input/output throu^, for example, software drivers and computer hardware for 
controlling output to display devices (180) such as computer display screens, as well 
20 as user input from user input devices (181) such as keyboards and mice. 

For further explanation. Figure 4 sets forth a flow chart illustrating an exemplary 
method for dynamically provisioning computer system resources that includes 
monitoring (502) a connection performance parameter (504) of a data 

25 conmiunications port (506) operating in a data conraiunications protocol (203) having 
a connection backlog queue (124) having a connection backlog queue size. A 
connection performance parameter is any measure of system performance in 
establishing data communications connections. Examples of connection performance 
parameters include round trip time, bandwidth delay product, connection request 

30 arrival intervals (the inverse of request rate), accept processing time, and connection 
backlog queue load. 



11 



AUS920031004US1 



Patent Application 



A data communications port is used by a data communications program that effects 
data communications with connections. Each port is assigned an identifying port 
number. Each server has an identifying network address. The combination of the 
5 port number and the network address uniquely identifies a data communications 
process anywhere in cyberspace. A port number in combination with a network 
address is the basic data complement of a socket. A socket having both the network 
address and port number of a client and a server is called a 'connection. ' In the 
example of Figure 4, the port operates in a transport layer, but that is for explanation, . 
10 not for limitation. In fact, such a port may be operated in any protocol layer that 
supports coimections for data communications. 

The method of Figure 4 also includes changing (508) the connection backlog queue 
size in dependence upon the monitored connection performance parameter (508) 

15 without interrupting the operation of the data communications port (506) and without 
user intervention. The ability to change the connection backlog queue size in 
dependence upon monitored connection performance parameters without interrupting 
the operation of the data communications port and without user intervention 
advantageously provides a mechanism for dynamic, on-demand provisioning of 

20 resources on a computer system. Although the system of Figure 4 is shown with only 
one port, readers of skill in the art will realize that many such systems support many 
such ports. The method of Figure 4 also provides the flexibility of using a per-port 
backlog size rather than enforcinjg a system- wide backlog size since some ports may 
be more heavily used tiian others. The server (106) can dynamically provision the 

25 resources, particularly computer memory, by increasing the backlog limit for this port 
on the fly, allowing it to gracefully manage overload conditions and reducing dropped 
connections, while keeping heed of system resources. 

Figure 5 sets forth a flow chart illustrating a further exemplary method for 
30 dynamically provisioning computer system resources in which monitoring a 

connection performance parameter includes receiving (602) a connection request 
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(604) and determining (606) that the connection backlog queue (124) is full. If the 
connection request backlog queue is not full (619), the incoming connection request 
is placed on the connection backlog queue in the usual fashion. In TCP, as mentioned 
earlier, enqueueing a connection request is carried out by creating a socket and 
5 placing the socket in the connection backlog queue for a port. 

In the method of Figure 5, changing the connection backlog queue size in dependence 
upon the monitored connection performance parameter includes increasing (610) the 
connection backlog queue size. If the connection request backlog queue is full (614) 

10 processing continues with a determination (608) whether the connection request 
backlog queue size can be increased. The determination process (608) operates by 
comparing the current size of the connection backlog queue with a system parameter 
(609) defining the maximum queue size permitted on the system, and the 
determination process compares all the total size of all connection backlog queues for 

1 5 all ports operating on the system with a system parameter (612) defining the 
maximum memory allocation for connection request backlog queues. 

If memory is available within the limit for all queues and the current size of the queue 
in question is smaller than the system maximum, then the process determines that it 

20 can (6 1 6) increase the size of the connection backlog queue and does so (6 1 0). The 
connection request is then enqueued (611) to await connection and acceptance. Note 
that in prior art, the connection request would have been dropped as soon as it was 
determined that the connection request backlog was full (614). In the method of 
Figure 5, the connection request is dropped (615) only if it is determined (618) that it 

25 is not possible to increase the queue size in view of system limits. 

Figure 6 sets forth a flow chart illustrating a still further exemplary method for 
dynamically provisioning computer system resources in which monitoring a 
connection performance parameter includes monitoring (702) a connection backlog 
30 queue load (704). Monitoring (702) a connection backlog queue load (704) may be 
carried out by having a process or thread periodically count the number of connection 
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requests in the connection backlog queue. The count may be stored in a table with 
timestamps for the counts, thereby creating a load profile. Load averages and running 
averages may be calculated from the profile. The system may be configured with 
load thresholds (710, 714) for use in determining whether to increase or decrease 
5 connection backlog queue size. The system may be configured with rules (712) for 
determining how to increase or decrease connection backlog queue size according to 
load. 

hi the method of Figure 6, changing the connection backlog queue size includes 
10 changing the backlog queue size in dependence upon the connection backlog queue 
load (704). In the method of Figure 6, if a measure of queue load (704) is greater 
than an increase threshold (710), connection backlog queue size is increased (720). If 
a measure of queue load (704) is less than a decrease threshold (714), the connection 
backlog queue size is decreased (722). The method of Figure 6 also may operate 
1 5 according to connection queue adjustment rules (712). An example of a connection 
queue adjustment rule is: 

• Rule 1 : if queue size is more than 10% larger or smaller than an average 
load, change queue size to 125% of the average load 

20 

Consider an example in which a connection backlog queue has a queue size of 50 
connection requests and a running average load of 48 connection requests. Such a 
queue occasionally fills and drops connections requests. Operating according to Rule 
1 above, the method of Figure 6 increases (720) the queue size to 60, thereby 
25 reducing the risk of a dropped connection requests. In an example with a queue size 
of 50 and a running average load of 10, the method of Figure 6 operating according to 
Rule 1 , decreases the queue size to 13, releasing memory for use by other processes, 
thereby improving efficiency of computer resource allocations. 

30 Figure 7 sets forth a flow chart illustrating a still fiirther exemplary method for 
dynamically provisioning computer system resources in which monitoring a 
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connection performance parameter includes calculating (806) an average round trip 
time for a portion of a connection handshake and calculating (808) an average arrival 
interval between connection requests. In this example, calculating an average round 
trip time is carried out by monitoring (802) round trip times, measuring them and 
5 storing them in a profile firom which a running average is calculated. In this example, 
calculating (808) an average arrival interval between connection requests is carried 
out by monitoring (804) request arrival times, storing them in a profile fi-om which a 
running average is calculated. In the method of Figure 7, changing the connection 
backlog queue size is carried out by increasing (812) the connection backlog queue 
10 size if the average arrival interval is less than the average roimd trip time and 

decreasing (814) the connection backlog queue size if the average arrival interval is 
greater than the average round trip time. 

Round trip time is explained further with reference to Figure 8. Figure 8 sets forth a 
15 calling sequence diagram illustrating a TCP connection handshake (910) to establish 
a connection between a client (108) and a server (106). TCP is used for ease of 
explanation, but the use of TCP is not a limitation of the present invention. Any 
protocol that supports connection-oriented data communications may be used. In 
TCP, the connection request as received by the server (106) is a TCP SYN message 
20 (902), so-called because it is identified as a connection request by setting the SYN 
('synchronize') flag in the TCP message header. 

When it receives a SYN message, the TCP service in the server operating system 
transmits a SYN-ACK message (904) back to the chent (108), the SYN flag in the 

25 message header representing a request to the client to proceed with establishing the 
connection and the ACK acknowledging receipt of the client's SYN (902). The TCP 
service on the server then creates a socket to hold the connection data, the network 
addresses and port numbers for the client and the server-side data communications 
application, and places the socket in the connection backlog queue. The socket waits 

30 in the connection backlog queue until a return ACK (906) is received from the client 
and the port on the server side accepts the connection. 

15 
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The sequence of messages required to establish a connection is a 'connection 
handshake.' The SYN/SYN-ACK/ACK sequence of messages (902, 904, 906) is an 
example of a connection handshake (910). The time interval (908) between the TCP 
5 service's sending of the SYN-ACK (904) and the receipt of the client's ACK (906) is 
a round trip time for a portion of a connection handshake. 

Figure 9 sets forth a flow chart illustrating another exemplary method for dynamically 
provisioning computer system resources. In the method of Figure 9 monitoring a 

10 connection performance parameter includes calculating (930) a bandwidth delay 
product (932) for a connection backlog queue (124) and comparing (934) the 
bandwidth delay product (932) with the queue size. The bandwidth portion of the 
bandwidth delay product is a measure of the data communications speed for the 
network data communications port. The bandwidth may be measured, calculated, or 

15 configured from a known network topology. In a network of know topology, for 
example, in which data communications is effected on a full rate Tl lines, the 
bandwidth is 1 .544 Mbps or 193,000 bytes/second. The delay portion of the 
bandwidth delay product is taken as one-half the round trip time. In the exemplary 
network with the Tl lines, for a port whose connection backlog queue runs with an - 

20 average round trip time of 100 milliseconds, the delay is 50 milliseconds, .05 

seconds. For this connection queue, the bandwidth delay product is 193,000 x .05 = 
bytes = 9650 bytes. If the size of each data communications packet in the data 
communications protocol for the port is one kilobyte, then 10 connection requests can 
fit in the channel, and the connection backlog queue size needed to accommodate all 

25 the connection requests that can fit in the channel is 10. The size of the data 
structures representing connection requests in the connection backlog queue, of 
course, is imlikely to be the same as the size of the data conmiunications packets. 

In the method of Figure 9, changing the connection backlog queue size includes 
30 changing (946) the backlog queue size to at least the bandwidth delay product (932) if 
the connection backlog queue size is less than the bandwidth delay product (938). 

16 
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Changing (946) the backlog queue size to at least the bandwidth delay product (932) 
if the connection backlog queue size is less than the bandwidth delay product (938) 
advantageously reduces the risk of dropping connection requests because the 
connection backlog queue is large enough in principle to contain all the data that can 
5 fit in the data communications channel on which its port listens. 

In the method of Figure 9, if the connection backlog queue size is less than the 
bandwidth delay product (938), changing the connection backlog queue size in 
dependence upon a monitored connection performance parameter processing 

10 continues with a determination (935) whether the connection request backlog queue 
size can be increased. The determination process (935) operates by comparing the 
current size of the connection backlog queue with a system parameter (609) defining 
the maximum queue size permitted on the system, and the determination process 
compares the total size of all connection backlog queues for all ports operating on the 

15 system with a system parameter (612) defining the maximum memory allocation for 
connection request backlog queues. If memory is available within the limit for all 
queues and the current size of the queue in question is smaller than the system 
maximum, then the process determines that it can (944) increase the size of the 
connection backlog queue and does so (946). 

20 , : : 

Figure 10 sets forth a flow chart illustrating a still fiirther exemplary method for 
dynamically provisioning computer system resources in which monitoring a 
connection performance parameter is carried out by measuring (950) accept 
processing time and monitoring (804) connection request arrival time. In the method 

25 of Figure 10, changing the connection backlog queue size is carried out by changing 
(958) the backlog queue size in dependence upon accept processing time and 
connection request arrival times. More particularly in the method of Figure 10, 
monitoring a connection performance parameter is carried out by calculating (952) an 
average accept processing time and calculating an average connection request arrival 

30 interval (808) for a connection backlog queue (124). In the method of Figure 10, 

changing the connection backlog queue size includes increasing (958) the connection 
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backlog queue size if the accept processing time is greater than the connection request 
arrival interval. 

The connection request arrival interval is the inverse of the connection request rate, 
5 the rate at which connection request arrive and are placed in the connection backlog 
queue. The average load of the connection backlog queue depends on the average 
round trip time between the server and its clients and depends also upon the 
connection request rate - because a connection request stays on the queue for a period 
of time equal to the round trip delay plus the accept processing time. Long round-trip 
1 0 delays and high request rates increase the length of the connection backlog queue. 
The connection backlog queue load also depends on how fast a server process calls 
acceptQ, that is, the rate at which it serves requests. If a server is operating at its 
maximiun capacity, it cannot call acceptQ fast enough to keep up with the connection 
request rate and the queue load increases. 

15 

The following is a pseudocode example of an exemplary server process that opens a 
socket on a port and accepts connections from a connection backlog queue: 

int listenSocket, connectSocket; 
20 int QUEUE_SIZE = 5; 

if ((listenSocket = socket( ...))< 0 ) ' v ^ 

err_sys("socket error"); 
if(bind(listenSocket, . . . ) < 0 ) 
err_sys("bind error"); 
25 if(listen(listenSocket, QUEUE_SIZE) < 0 ) 

err_sys("listen error"); 
for(;;){ 

connectSocket = accept(connectSocket, . . . ); /* blocks */ 
if(connectSocket <0) 
30 err_sys("accept error"); 
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ifl[forkO = 0) { 

/*** child processing ***/ 

close(listenSocket); 

doit(connectSocket); 
5 exit(0); 
} 

close(connectSocket); 

} 

10 When a connection request is received and accepted, the process forks, with the child 
process servicing the connection and the parent process waiting for another 
connection request. The connectSocket descriptor returned by acceptQ refers to a 
complete TCP association, a ^connection,' a data structure housing the complete 
network addresses and port numbers for both client and server for this connection. 

15 On the other hand, the listenSocket argument that is passed to acceptQ only has the 
network address and the port number for the server process. The chent network 
address and client port number are unknown at that point and remain so until acceptQ 
retums. This allows the original process, the parent, to acceptQ another connection 
using listenSocket without having to create another socket descriptor. This server, 

20 . like most connection - oriented servers, is a concurrent processors,, and so creates a 
' new socket ('connectSocket') automatically as part of the acceptQ system call, hi a 
TCP system, connectSocket is typically the socket representing the next connection 
request on the connection backlog queue. In this way, the system continues to use the 
same socket for all listening on the port ('listenSocket'), while using sockets from the 

25 connection backlog queue as connections for server processing. 

Accept processing time is the time interval between calls to acceptQ. If there is no 
connected socket ready on the connection backlog queue, acceptQ blocks and waits 
for one. If forkQ and closeQ processing are fast, therefore, the accept processing rate 
30 is the request rate. ForkQ and closeQ, however, are CPU-bound system calls. If 
forkQ and closeQ processing are slow enough to reduce the accept processing rate 
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below the request rate, the connection backlog queue load will increase. The method 
of Figure 10, therefore advantageously includes comparing (954) the accept 
processing time and the arrival interval (the inverse of the request rate). If the accept 
processing time is larger (956) than the arrival interval, the method of Figure 10 
5 includes increasing (958) the connection backlog queue size. 

It will be understood from the foregoing description that modifications and changes 
may be made in various embodiments of the present invention without departing from 
its true spirit. The descriptions in this specification are for purposes of illustration 
10 only and are not to be construed in a limiting sense. The scope of the present 
invention is limited only by the language of the following claims. 
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